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TECHNICAL FIELD OF THE INVENTION 

The present invention is related to a method of computer control and, more 
particularly, to a method for utilizing a visual cue in conjunction web access. 

CROSS-REFERENCE TO RELATED APPLICATIONS 
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15 THE CONTENT OF VIDEO TAPE MEDIA," filed on August 19, 1999; Serial No. 

(Atty Dkt. No. PHLY-24,706) entitled "A METHOD FOR 
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filed on August 19, 1999; Serial No. (Atty Dkt. No. PHLY-24,708) entitled 
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(Atty Dkt. No. PHLY-24,732) entitled "METHOD AND APPARATUS 

FOR COMPLETING, SECURING AND CONDUCTING AN E-COMMERCE 
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TRANSACTION;" Serial No. (Atty Dkt. No. PHLY-24,733) entitled 

"METHOD AND APPARATUS FOR TRACKING USER PROFILE AND HABITS 

ON A GLOBAL NETWORK;" Serial No. (Atty Dkt. No. PHLY- 

24,734) entitled "METHOD AND APPARATUS FOR DIRECTING AN EXISTING 
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1 0 Serial No. (Atty Dkt. No. PHLY-24,737) entitled "METHOD AND 
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entitled "METHOD AND APPARATUS FOR MATCHING A USER'S USE 
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1 5 (Atty Dkt. No. PHLY-24,739) entitled "METHOD AND APPARATUS FOR 

UTILIZING AN AUDIBLE SIGNAL TO INDUCE A USER TO SELECT AN E- 

COMMERCE FUNCTION;" Serial No. (Atty Dkt. No. PHLY-24,741) 

entitled "DIGITAL ID FOR SELECTING WEB BROWSER AND USE 
PREFERENCES OF A USER DURING USE OF A WEB APPLICATION;" Serial No. 

20 (Atty Dkt. No. PHLY-24,742) entitled "UNIQUE ID FOR IDENTIFYING 

A USER AND FACILITATING AN E-COMMERCE TRANSACTION;" Serial No. 

(Atty Dkt. No. PHLY-24,743) entitled "METHOD AND APPARATUS 

FOR LINKING A WEB BROWSER TO A PROMOTIONAL OFFER OVER A 
GLOBAL NETWORK;" Serial No. (Atty Dkt. No. PHLY-24,744) 
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BACKGROUND OF THE INVENTION 

With the growing numbers of computer users connecting to the "Internet," many 
companies are seeking the substantial commercial opportunities presented by such a 
large user base. For example, one technology which exists allows a television ("TV") 
5 signal to trigger a computer response in which the consumer will be guided to a 

personalized web page. The source of the triggering signal may be a TV, video tape 
recorder, or radio. For example, if a viewer is watching a TV program in which an 
advertiser offers viewer voting, the advertiser may transmit a unique signal within the 
television signal which controls a program known as a "browser" on the viewer's 
1 0 computer to automatically display the advertiser's web page. The viewer then simply 
makes a selection which is then transmitted back to the advertiser. 

In order to provide the viewer with the capability of responding to a wide 
variety of companies using this technology, a database of company information and 
Uniform Resource Locator ("URL") codes is necessarily maintained in the viewer's 

1 5 computer, requiring continuous updates. URLs are short strings of data that identify 

resources on the Internet: documents, images, downloadable files, services, electronic 
mailboxes, and other resources. URLs make resources available under a variety of 
naming schemes and access methods such as HTTP, FTP, and Intemet mail, 
addressable in the same simple way. URLs reduce the tedium of "login to this server, 

20 then issue this magic command ..." down to a single click. The Intemet uses URLs to 
specify the location of files on other servers. A URL includes the type of resource 
being accessed (e.g., Web, gopher, FTP), the address of the server, and the location of 
the file. The URL can point to any file on any networked computer. Current 
technology requires the viewer to perform periodic updates to obtain the most current 

25 URL database. This aspect of the current technology is cumbersome since the update 

process requires downloading information to the viewer's computer. Moreover, the 
likelihood for error in performing the update, and the necessity of redoing the update in 
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the event of a later computer crash, further comphcates the process. Additionally, 
current technologies are limited in the number of companies which may be stored in the 
database. This is a significant limitation since world-wide access presented by the 
Internet and the increasing number of companies connecting to perform on-line E- 
5 commerce necessitates a large database. 
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SUMMARY OF THE INVENTION 

The present invention disclosed and claimed herein comprises a visual indicia or 
cue for facilitating computer based access of a netw^ork by a consumer witnessing a 
presentation. A visual indicia or cue is provided during the presentation indicative of a 
5 relationship between the visual indicia or cue and the presence of a location on a 

network. This allows this location on the network to be accessed by a computer having 
an appropriate input device for responding to a launch signal associated with the visual 
indicia or cue wherein such response of the input device will connect the computer to 
the location. 
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BRIEF DESCRIPTION OF THE DRAWINGS 

For a more complete understanding of the present invention and the advantages 
thereof, reference is now made to the following description taken in conjunction with 
the accompanying Drawings in which: 
5 FIGURE 1 illustrates a block diagram of the preferred embodiment; 

FIGURE 2 illustrates the computer components employed in this embodiment; 

FIGURE 3 illustrates system interactions over a global network; 

FIGURES 4a-4e illustrate the various message packets transmitted between the 
source PC and network servers used in the preferred embodiment; and 
10 FIGURE 5 is a flowchart depicting operation of the system according to the 

preferred embodiment. 

FIGURE 6 illustrates a flowchart of actions taken by the Advertiser Reference 
Server ("ARS") server; 

FIGURE 7 illustrates a flowchart of the interactive process between the source 
1 5 computer and ARS ; 

FIGURE 8 illustrates a web browser page receiving the modified 
URL/advertiser product data according to the preferred embodiment; 

FIGURE 9 illustrates a simplified block diagram of the disclosed embodiment; 

FIGURE 10 illustrates a more detailed, simplified block diagram of the 
20 embodiment of FIGURE 9; 

FIGURE 1 1 illustrates a diagrammatic view of a method for performing the 
routing operation; 

FIGURE 12 illustrates a block diagram of an alternate embodiment utilizing an 
optical region in the video image for generating the routing information; 
25 FIGURE 13 illustrates a block diagram illustrating the generation of a profile 

with the disclosed embodiment; 

FIGURE 14 illustrates a flowchart for generating the profile and storing at the 

ARS; 
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FIGURE 15 illustrates a flowchart for processing the profile information when 
information is routed to a user; 

FIGURE 16 illustrates a general block diagram of a disclosed embodiment; 

FIGURE 16a illustrates a flowchart depicting the operation wherein the input 
5 device is registered; 

FIGURE 17 illustrates the conversion circuit of the wedge interface; 

FIGURE 1 8 illustrates a sample message packet transmitted from the user PC to 
the ARS; 

FIGURE 19 illustrates a more detailed block diagram of the routing of the 
1 0 message packets between the various nodes; 

FIGURE 20 illustrates a block diagram of a browser window, according to a 
disclosed embodiment; 

FIGURE 21 illustrates a diagrammatic view of information contained in the 
ARS database; 

15 FIGURE 22 illustrates a flowchart of the process of receiving information for 

the user's perspective; 

FIGURE 23 illustrates a flowchart according to the ARS; and 
FIGURE 24 illustrates a flowchart of the process performed at the E-commerce 
node; and 

20 FIGURES 25a and 25b illustrate the operation wherein a bar code is associated 

with a unique indicia. 

FIGURE 26 illustrates a block diagram of an alternate embodiment; 
FIGURE 26a illustrates a diagrammatic view of the interaction between a user 
viewing a broadcast and a computer display; 
25 FIGURE 27 illustrates one embodiment of a visual cue; 

FIGURE 28a illustrates a first cell of an animation sequence involving a visual 

cue; 

FIGURE 28b illustrates a second cell of an animation sequence involving a 
visual cue; 
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FIGURE 28c illustrates a third cell of an animation sequence involving a visual 

cue; 

FIGURE 29a illustrates a first cell of an alternate animation sequence involving 
a visual cue; 

5 FIGURE 29b illustrates a second cell of the alternate animation sequence of 

FIGURE 29a; 

FIGURE 29c illustrates a third cell of the alternate animation sequence of 
FIGURE 29a; 

FIGURE 30 illustrates a flowchart of one embodiment of the operation of the 
10 embodiment of FIGURE 26. 
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DETAILED DESCRIPTION OF THE INVENTION 

Referring now to FIGURE 1, there is illustrated a block diagram of a system for 
controlling a personal computer ("PC") 1 12 via an audio tone transmitted over a 
wireless system utilizing a TV. In the embodiment illustrated in FIGURE 1, there is 
5 provided a transmission station 101 and a receive station 117 that are connected via a 
communication link 108. The transmission station 101 is comprised of a television 
program source 104, which is operable to generate a program in the form of a broadcast 
signal comprised of video and audio. This is transmitted via conventional techniques 
along channels in the appropriate frequencies. The program source is input to a mixing 
10 device 106, which mixing device is operable to mix in an audio signal. This audio 

signal is derived from an audio source 100 which comprises a coded audio signal which 
^ is then modulated onto a carrier which is combined with the television program source 

3 104. This signal combining can be done at the audio level, or it can even be done at the 

fi RF level in the from of a different carrier. However, the preferred method is to merely 

Z 15 sum the audio signal from the modulator 102 into the audio channel of the program that 

is generated by the television program source 104. The output thereof is provided from 
X the mixing device 106 in the form of broadcast signal to an antenna 107 , which 

rj transmits the information over the communication link 108 to an antenna 109 on the 

3 receive side. 

3 

20 On the receive side of the system, a conventional receiver 110, such as a 

television is provided. This television provides a speaker output which provides the 
user with an audible signal. This is typically associated with the program. However, 
the receiver 1 10 in the disclosed embodiment, also provides an audio output jack, this 
being the type RCA jack. This jack is utilized to provide an audio output signal on a 

25 line 1 13 which is represented by an audio signal 111. This line 113 provides all of the 
audio that is received over the communication link 108 to the PC 1 12 in the audio input 
port on the PC 112. However, it should be understood that, although a direct 
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connection is illustrated from the receiver 1 10 to the PC 1 12, there actually could be a 
microphone pickup at the PC 1 12 which could pick the audio signal up. In the 
disclosed embodiment the audio signal generated by the advertiser data input device 
100 is audible to the human ear and, therefore, can be heard by the user. Therefore, no 
5 special filters are needed to provide this audio to the PC 112. 

The PC 1 12 is operable to run programs thereon which typically are stored in a 
program file area 116. These programs can be any type of programs such as word 
processing programs, application programs, etc. In the disclosed embodiment, the 
program that is utilized in the system is what is referred to as a "browser." The PC 1 12 
1 0 runs a browser program to facilitate the access of information on the network, for 

example, a global communication network known as the "Internet" or the World-Wide- 
3 Web ("Web"). The browser is a hypertext-linked application used for accessing 

1 information. Hypertext is a term used to describe a particular organization of 

=1 information within a data processing system, and its presentation to a user. It exploits 

^15 the computer's ability to link together information from a wide variety of sources to 

provide the user with the ability to explore a particular topic. The traditional style of 
^ presentation used in books employs an organization of the information which is 

f, imposed upon it by limitations of the medium, namely fixed sized, sequential paper 

J pages. Hypertext systems, however, use a large number of units of text or other types 

20 of data such as image information, graphical information, video information, or sound 
information, which can vary in size. A collection of such units of information is termed 
a hypertext document, or where the hypertext documents employ information other than 
text, hypermedia documents. Multimedia communications may use the Hypertext 
Transfer Protocol ("HTTP"), and files or formatted data may use the Hypertext Markup 
25 Language ("HTML"). This formatting language provides for a mingling of text, 

graphics, sound, video, and hypertext links by "tagging" a text document using HTML. 
Data encoded using HTML is often referred to as an "HTML document," an "HTML 
page," or a "home page." These documents and other Internet resources may be 
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accessed across the network by means of a network addressing scheme which uses a 
locator referred to as a Uniform Resource Locator ("URL"), for example, 
•'http://www.digital.com." 

The Internet is one of the most utilized networks for interconnecting distributed 
5 computer systems and allows users of these computer systems to exchange data all over 
the world. Connected to the Internet are many private networks, for example, corporate 
or commercial networks. Standard protocols, such as the Transport Control Protocol 
('TCP") and the Internet Protocol (*'IP") provide a convenient method for 
communicating across these diverse networks. These protocols dictate how data are 

10 formatted and communicated. As a characteristic of the Internet, the protocols are 
layered in an IP stack. At higher levels of the IP stack, such as the application layer 
(where HTTP is employed), the user information is more readily visible, while at lower 
levels, such as the network level (where TCP/IP are used), the data can merely be 
observed as packets or a stream of rapidly moving digital signals. Superimposed on the 

15 Internet is a standard protocol interface for accessing Web resources, such servers, files, 
Web pages, mail messages, and the like. One way that Web resources can be accessed 
is by browsers made by Netscape® and Microsoft Internet Explorer®, 

Referring again now to FIGURE 1, the user can load this program with the 
appropriate keystrokes such that a browser window will be displayed on a display 118. 

20 In one embodiment, the user can run the browser program on the PC 1 12 such that the 
browser window is displayed on the display 118. While watching a preferred program, 
the user can also view display 118. When an audio signal is received by the receiver 
110 and the encoded information is contained therein that was input thereto by the 
advertiser, the PC 1 12 will then perform a number of operations. The first operation, 

25 according to the disclosed embodiment, is to extract the audio information within the 
received audio signal in the form of digital data, and then transmit this digital data to a 
defined location on the global communication network via a modem connection 1 14. 
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This connection will be described hereinbelow. This information will be relayed to a 
proprietary location and the instructions sent back to the PC 1 12 as to the location of 
the advertiser associated with the code, and the PC 1 12 will then effect a 
communication link to that location such that the user can view on the display 118 
5 information that the advertiser, by the fact of putting the tone onto the broadcast 

channel, desires the viewer to view. This information can be in the form of interactive 
programs, data files, etc. In one example, when an advertisement appears on the 
television, the tone can be generated and then additional data displayed on the display 
118. Additionally, a streaming video program could be played on the PC received over 
10 the network, which streaming video program is actually longer than the advertising 
segment on the broadcast. Another example would be a sports game that would 
broadcast the tone in order to allow a user access to information that is not available 
over the broadcast network, such as additional statistics associated with the sports 
program, etc. 

1 5 By utilizing the system described herein with respect to the disclosed 

embodiment of FIGURE 1, an advertiser is allowed the ability to control a user's PC 
112 through the use of tones embedded within a program audio signal. As will descried 
hereinbelow, the disclosed embodiment utilizes particular routing information stored in 
the PC 1 12 which allows the encoded information in the received audio signal to route 

20 this information to a desired location on the network and then allow other routing 

information to be returned to the PC 1 12 for control thereof to route the PC 1 12 to the 
appropriate location associated with that code. 

Referring now to FIGURE 2, there is illustrated a computer 204, similar to 
computer 1 12, connected to display information on display 118. The computer 204 
25 comprises an internal audio or "sound" card 206 for receiving the transmitted audio 
signal through receive antenna 109 and receiver 1 10. The sound card 206 typically 
contains analog-to-digital circuitry for converting the analog audio signal into a digital 
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signal. The digital signal may then be more easily manipulated by software programs. 
The receiver 110 separates the audio signal from the video signal. A special trigger 
signal located within the transmitted advertiser audio signal triggers proprietary 
software running on the computer 204 which launches a communication application, in 
5 this particular embodiment, the web browser application located on the PC 204. Coded 
advertiser information contained within the audio signal is then extracted and appended 
with the address of a proprietary server located on the communication network. The 
remote server address is in the form of a URL. This appended data, in addition to other 
control codes, is inserted directly into the web browser application for automatic 
10 routing to the communication network. 

The web browser running on PC 204, and conmiunicating to the network with a 
through an internal modem 208, in this embodiment, transmits the advertiser 
information to the remote server. The remote server cross-references the advertiser 
product information to the address of the advertiser server located on the network. The 

15 address of the advertiser server is routed back through the PC 204 web browser to the 

advertiser server. The advertiser product information is returned to PC 204 to be 
presented to the viewer on display 118. In this particular embodiment, the particular 
advertiser product information displayed is contained within the advertiser's web page 
212. As mentioned above, the audio signal is audible to the human ear. Therefore the 

20 audio signal, as emitted from the TV speakers, may be input to the sound card 206 via a 
microphone. Furthermore, the audio signal need not be a real-time broadcast, but may 
be on video tapes, CDs, DVD, or other media which may be displayed at a later date. 
With the imminent implementation of high definition digital television, the audio signal 
output from the TV may also be digital. Therefore, direct input into a sound card for 

25 A/D purposes may not be necessary, but alternative interfacing techniques to 

accommodate digital-to-digital signal formats would apply. 
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Referring now to FIGURE 3, there is illustrated a source PC 302, similar to PCs 
204 and 112, connected to a global communication network 306 through an interface 
304. In this embodiment, the audio signal 1 11 is received by PC 302 through its sound 
card 206. The audio signal 1 1 1 comprises a trigger signal which triggers proprietary 
5 software into launching a web browser application residing on the PC 302. The audio 
signal 1 1 1 also comprises advertiser product information which is extracted and 
appended with URL information of an Advertiser Reference Server ("ARS") 308. The 
ARS 308 is a system disposed on the network that is defined as the location to which 
data in the audio signal 111 is to be routed. As such, data in the audio signal 111 will 

10 always be routed to the ARS 308, since a URL is unique on the network system. 
Connected to the ARS 308 is a database 310 of product codes and associated 
manufacturer URLs, The database 310 undergoes a continual update process which is 
transparent to the user. As companies sign-on, e.g., subscribe, to this technology, 
manufacturer and product information is added to the database 310 without interrupting 

15 operation of the source PC 302 with fi-equent updates. When the advertiser server 

address URL is obtained from the ARS database 310, it and the request for the 
particular advertiser product information is automatically routed back through the web 
browser on PC 302, over to the respective advertiser server for retrieval of the 
advertiser product information to the PC 302. It should be noted that although the 

20 disclosed invention discusses a global communication network, the system is also 
applicable to LANs, WANs, and peer-to-peer network configurations. It should be 
noted that the disclosed architecture is not limited to a single source PC 302, but may 
comprise a plurality of source PCs, e.g., PC 300 and PC 303. Moreover, a plurality of 
ARS 308 systems and advertiser servers 312 may be implemented, e.g., ARS 314, and 

25 advertiser server A 3 1 6, respectively. 

The information transactions, in general, which occur between the networked 
systems of this embodiment, over the communication network, are the following. The 
web browser running on source PC 302 transmits a message packet to the ARS 308 
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over Path "A." The ARS 308 decodes the message packet and performs a cross- 
reference function with product information extracted from the received message packet 
to obtain the address of an advertiser server 312. A new message packet is assembled 
comprising the advertiser server 312 address, and sent back to the source PC 302 over 
5 Path "B." A "handoff operation is performed whereby the source PC 302 browser 

simply reroutes the information on to the advertiser server 312 over Path "C," with the 
appropriate source and destination address appended. The advertiser server 312 
receives and decodes the message packet. The request-for-advertiser-product- 
information is extracted and the advertiser 312 retrieves the requested information from 

10 its database for transmission back to the source PC 302 over Path "D." The source PC 
302 then processes the information, i.e., for display to the viewer. The optional Path 
"E" is discussed hereinbelow. It should be noted that the disclosed methods are not 
limited to only browser communication applications, but may accommodate, with 
sufficient modifications by one skilled in the art, other communication applications 

1 5 used to transmit information over the Internet or communication network. 

Referring now to FIGURE 4a, the message packet 400 sent from the source PC 
302 to ARS 308 via Path "A" comprises several fields. One field comprises the URL of 
the ARS 308 which indicates where the message packet is to be sent. Another field 
comprises the advertiser product code or other information derived from the audio 

20 signal 111, and any additional overhead information required for a given transaction. 

The product code provides a link to the address of the advertiser server 312, located in 
the database 310. Yet another field comprises the network address of the source PC 
302. In general, network transmissions are effected in packets of information, each 
packet providing a destination address, a source address, and data. These packets vary 

25 depending upon the network transmission protocol utilized for communication. 

Although the protocols utilized in the disclosed embodiment are of a conventional 
protocol suite commonly known as TCP/IP, it should be understood that any protocols 
providing the similar basic fimctions can be used, with the primary requirement that a 
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browser can forward the routing information to the desired URL in response to 
keystrokes being input to a PC. However, it should be understood that any protocol can 
be used, with the primary requirement that a browser can forward the product 
information to the desired URL in response to keystrokes being input to a PC. Within 
5 the context of this disclosure, "message packet" shall refer to and comprise the 

destination URL, product information, and source address, even though more than a 
' single packet must be transmitted to effect such a transmission. 

Upon receipt of the message packet 400 from source PC 302, ARS 308 
processes the information in accordance with instructions embedded in the overhead 
10 information. The ARS 308 specifically will extract the product code information from 
3 the received packet 400 and, once extracted, will then decode this product code 

information. Once decoded, this information is then compared with data contained 
2 within the ARS advertiser database 3 1 0 to determine if there is a "hit." If there is no 

[| "hit" indicating a match, then information is retumed to the browser indicating such. If 

Z 15 there is a "hit," a packet 402 is assembled which comprises the address of the source PC 

302, and information instructing the source PC 302 as to how to access, directly in a 
^ "handoff ' operation, another location on the network, that of an advertiser server 312. 

|1 This type of construction is relatively conventional with browsers such as Netscape® 

^ and Microsoft Internet Explorer® and, rather than displaying information from the ARS 

20 308, the source PC 302 can then access the advertiser server 312. The ARS 308 
transmits the packet 402 back to source PC 302 over Path "B." Referring now to 
FIGURE 4b, the message packet 402 comprises the address of the source PC 302, the 
URL of the advertiser server 312 embedded within instructional code, and the URL of 
the ARS 308. 

25 Upon receipt of the message packet 402 by the source PC 302, the message 

packet 402 is disassembled to obtain pertinent routing information for assembly of a 
new message packet 404. The web browser running on source PC 302 is now directed 
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to obtain, over Path "C," the product information relevant to the particular advertiser 
server 312 location information embedded in message packet 404. Referring now to 
FIGURE 4c, the message packet 404 for this transaction comprises the URL of the 
advertiser server 312, the request- for-product-information data, and the address of the 
5 source PC 302. 



Upon receipt of the message packet 404 from source PC 302, advertiser server 
312 disassembles the message packet 404 to obtain the request- for-product-information 
data. The advertiser server 312 then retrieves the particular product information from 
its database, and transmits it over Path "D" back to the source PC 302. Referring now 
10 to FIGURE 4d, the message packet 406 for this particular transaction comprises the 

address of the source PC 302, the requested information, and the URL of the advertiser 
server 312. 



Optionally, the ARS 308 may make a direct request for product information 
over Path "E" to advertiser server 312. In this mode, the ARS 308 sends information to 

15 the advertiser server 312 instructing it to contact the source PC 302. This, however, is 
unconventional and requires more complex software control. The message packet 408 
for this transaction is illustrated in FIGURE 4e, which comprises the URL of the 
advertiser server 312, the request- for-product-information data, and the address of the 
source PC 302. Since product information is not being returned to the ARS 308, but 

20 directly to the source PC 302, the message packet 408 requires the return address to be 
that of the source PC 302. The product information is then passed directly to PC 302 
over Path "D." 



Referring now to FIGURE 5, the method for detecting and obtaining product 
information is as follows. In decision block 500, a proprietary application running 
25 resident on a source computer PC 302 (similar to PC 204) monitors the audio input for 

a special trigger signal. Upon detection of the trigger signal, data following the trigger 
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signal is decoded for further processing, in function block 502. In function block 504, 
the data is buffered for further manipulation. In decision block 506, a determination is 
made as to whether the data can be properly authenticated. If not, program flow 
continues through the "N" signal to function block 520 where the data is discarded. In 
5 function block 522, the program then signals for a retransmission of the data. The 
system then waits for the next trigger signal, in decision block 500. If properly 
authenticated in decision block 506, program flow continues through the "Y" signal 
path where the data is then used to launch the web browser application, as indicated in 
function block 508. In function block 510, the web browser receives the URL data, 

10 which is then automatically routed through the computer modem 208 to the network 
interface 304 and ultimately to the network 306. In function block 514, the ARS 308 
responds by returning the URL of advertiser server 312 to the PC 302. In function 
block 516, the web browser running on the source PC 302, receives the advertiser URL 
information from the ARS 308, and transmits the URL for the product file to the 

1 5 advertiser server 312. In block 5 1 8, the advertiser server 312 responds by sending the 
product information to the source PC 302 for processing. 

The user may obtain the benefits of this architecture by simply downloading the 
proprietary software over the network. Other methods for obtaining the software are 
well-known; for example, by CD, diskette, or pre-loaded hard drives. 

20 Referring now to FIGURE 6, there is illustrated a flowchart of the process the 

ARS 308 may undergo when receiving the message packet 400 from the source PC 302. 
In decision block 600, the ARS 308 checks for the receipt of the message packet 400. 
If a message packet 400 is not received, program flow moves along the "N" path to 
continue waiting for the message. If the message packet 400 is received, program flow 

25 continues along path "Y" for message processing. Upon receipt of the message packet 
400, in function block 602, the ARS 308 decodes the message packet 400. The product 
code is then extracted independently in function block 604 in preparation for matching 
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the product code with the appropriate advertiser server address located in the database 
310. In function block 606, the product code is then used with a lookup table to retrieve 
the advertiser server 312 URL of the respective product information contained in the 
audio signal data. In function block 608, the ARS 308 then assembles message packet 
5 402 for transmission back to the source PC 302. Function block 610 indicates the 

process of sending the message packet 402 back to the source PC 302 over Path "B." 

Referring now to FIGURE 7, there is illustrated a flowchart of the interactive 
processes between the source PC 302 and the advertiser server 312. In function block 
700, the source PC 302 receives the message packet 402 back from the ARS 308 and 

10 begins to decode the packet 402. In function block 702, the URL of the advertiser 

product information is extracted from the message packet 402 and saved for insertion 
into the message packet 404 to the advertiser server 312. The message packet 404 is 
then assembled and sent by the source PC 302 over Path "C" to the advertiser server 
312, n function block 704. While the source PC 302 waits, in function block 706, the 

1 5 advertiser server 3 1 2 receives the message packet 404 from the source PC 302, in 
function block 708, and disassembles it. The product information location is then 
extracted from the message packet 404 in function block 710. The particular product 
information is retrieved from the advertiser server 312 database for transmission back to 
the source PC 302. In function block 712, the product information is assembled into 

20 message packet 406 and then transmitted back to the source PC 302 over Path "D." 
Returning to the source PC 302 in function block 714, the advertiser product 
information contained in the message packet 406 received from the advertiser server 
3 1 2, is then extracted and processed in function block 716. 

Referring now to FIGURE 8, after receipt of a trigger signal, a web browser 
25 application on a source PC 302 is automatically launched and computer display 800 
presents a browser page 802. Proprietary software running on the source PC 302 
processes the audio signal data after being digitized through the sound card 206. The 



Atty. Dkt. No.: PHLY-25,509 



22 



software appropriately prepares the data for insertion directly into the web browser by 
extracting the product information code and appending keystroke data to this 
information. First, a URL page 804 is opened in response to a Ctrl-0 command added 
by the proprietary software as the first character string. Opening URL page 804 
5 automatically positions the cursor in a field 806 where additional keystroke data 

following the Ctrl-0 command will be inserted. After URL page 804 is opened, the 
hypertext protocol preamble http:// is inserted into the field 806. Next, URL 
information associated with the location of the ARS 308 is inserted into field 806. 
Following the ARS 308 URL data are the characters /? to allow entry of variables 

10 immediately following the /? characters. In this embodiment, the variable following is 
the product information code received in the audio signal. The product code 
information also provides the cross-reference information for obtaining the advertiser 
URL fi-om the ARS database 310. Next, a carriage return is added to send the 
URL/product data and close the window 804. After the message packet 400 is 

15 transmitted to the ARS 308 firom the source PC 302, transactions from the ARS308, to 

the source PC 302, to the advertiser server 312, and back to the source PC 302, occur 
quickly and are transparent to the viewer. At this point, the next information the viewer 
sees is the product information which was received fi-om the advertiser server 312. 

Referring now to FIGURE 9, there is illustrated a block diagram of a more 
20 simplified embodiment. In this embodiment, a video source 902 is provided which is 
operable to provide an audio output on an audio cable 901 which provides routing 
information referred to by reference numeral 904. The routing information 904 is 
basically information contained within the audio signal. This is an encoded or 
embedded signal The important aspect of the routing information 904 is that it is 
25 automatically output in realtime as a fiincfion of the broadcast of the video program 

received over the video source 902. Therefore, whenever the program is being 
broadcast in realtime to the user 908, the routing information 904 will be output 
whenever the producer of the video desires it to be produced. It should be understood 
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that the box 902 representing the video source could be any type of media that will 
result in the routing information being output. This could be a cassette player, a DVD 
player, an audio cassette, a CD ROM or any such media. It is only important that this is 
a program that the producer develops which the user 908 watches in a continuous or a 
5 streaming manner. Embedded within that program, at a desired point selected by the 
producer, the routing information 904 is output. 

The audio information is then routed to a PC 906, which is similar to the PC 1 12 
in FIGURE 1. A user 908 is interfaced with the PC to receive information thereof, the 
PC 906 having associated therewith a display (not shown). The PC 906 is interfaced 
10 with a network 910, similar to the network 306 in FIGURE 3. This network 910 has 

multiple nodes thereon, one of which is the PC 906, and another of which is represented 
3 by a network node 912 which represents remote information. The object of the present 

3 embodiment is to access remote information for display to the user 908 by the act of 

=2 transmitting from the video program in block 902 the routing information 904. This 

^ 1 5 routing information 904 is utilized to allow the PC 906 which has a network "browser" 
running thereon to "fetch" the remote information at the node 912 over the network 910 
^ for display to the user 908. This routing information 904 is in the form of an embedded 

^ code within the audio signal, as was described hereinabove. 

Referring now to FIGURE 10, there is illustrated a more detailed block diagram 
20 of the embodiment of FIGURE 9. In this embodiment, the PC 906 is split up into a 
couple of nodes, a first PC 1002 and a second PC 1004. The PC 1002 resides at the 
node associated with the user 908, and the PC 1004 resides at another node. The PC 
1004 represents the ARS 308 of FIGURE 3. The PC 1004 has a database 1006 
associated therewith, which is basically the advertiser database 310. Therefore, there 
25 are three nodes on the network 910 necessary to implement the disclosed embodiment, 
the PC 1002, the PC 1004 and the remote information node 912. The routing 
information 904 is utilized by the PC 1002 for routing to the PC 1004 to determine the 
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location of the remote information node 912 on the network 910. This is returned to the 
PC 1002 and a connection made directly with the remote information node 912 and the 
information retrieved therefrom to the user 908. The routing information 904 basically 
constitutes primary routing information. 

5 Referring now to FIGURE 11, there is illustrated a diagrammatic view of how 

the network packet is formed for sending the primary routing information to the PC 
1004. In general, the primary routing information occupies a single field which primary 
routing information is then assembled into a data packet with the secondary routing 
information for transfer to the network 910. This is described hereinabove in detail. 

10 Referring now to FIGURE 12, there is illustrated an alternate embodiment to 

that of FIGURE 9. In this embodiment, the video source 902 has associated therewith 
an optical region 1202, which optical region 1202 has disposed therein an embedded 
video code. This embedded video code could be relatively complex or as simple as a 
grid of dark and white regions, each region in the grid able to have a dark color for a 

15 logic "1" or a white region for a logic "0." This will allow a digital value to be 
disposed within the optical region 1202. A sensor 1204 can then be provided for 
sensing this video code. In the example above, this would merely require an array of 
optical detectors, one for each region in the grid to determine whether this is a logic "1" 
or a logic "0" state. One of the sensed video is then output to the PC 906 for processing 

20 thereof to determine the information contained therein, which information contained 
therein constitutes the primary routing information 904. Thereafter, it is processed as 
described hereinabove with reference to FIGURE 9. 

Referring now to FIGURE 13, there is illustrated a block diagram for an 
25 embodiment wherein a user's profile can be forwarded to the original subscriber or 
manufacturer. The PC 906 has associated therewith a profile database 1302, which 
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profile database 1302 is operable to store a profile of the user 908. This profile is 
created when the program, after initial installation, requests profile information to be 
input in order to activate the program. In addition to the profile, there is also a unique 
ID that is provided to the user 908 in association with the browser program that runs on 
5 the PC 906. This is stored in a storage location represented by a block 1 304. This ID 
1304 is accessible by a remote location as a "cookie" which is information that is stored 
in the PC 906 in an accessible location, which accessible location is actually accessible 
by the remote program running on a remote node. 

The ARS 308, which basically constitutes the PC 1004 of FIGURE 10, is 
10 operable to have associated therewith a profile database 1308, which profile database 
1308 is operable to store profiles for all of the users. The profile database 1308 is a 
combination of the stored in profile database 1302 for all of the PCs 906 that are 
attachable to the system. This is to be distinguished from information stored in the 
database 310, the advertiser's database, which contains intermediate destination tables. 
1 5 When the routing information in the primary routing information 904 is forwarded to 
the ARS 308 and extracted from the original data packet, the lookup procedure 
described hereinabove can then be performed to determine where this information is to 
be routed. The profile database 1302 is then utilized for each transaction, wherein each 
transaction in the form of the routing information received from the primary routing 
20 information 904 is compared to the destination tables 3 10 to determine what 
manufacturer it is associated with. 

The associated ID 1304 that is transmitted along with the routing information in 
primary routing information 904 is then compared with the profile database 1308 to 
determine if a profile associated therewith is available. This information is stored in a 
25 transaction database 1310 such that, at a later time, for each routing code received in the 
form of the information in primary routing information 904, there will associated 
therewith the IDs 1304 of each of the PCs 906. The associated profiles in database 
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1308, which are stored in association with IDs 1304, can then be assembled and 
transmitted to a subscriber as referenced by a subscriber node 1312 on the network 910. 
The ARS 308 can do this in two modes, a realtime mode or a non-realtime mode. In a 
realtime mode, each time a PC 906 accesses the advertiser database 310, that user's 
5 profile information is uploaded to the subscriber node 1312. At the same time, billing 

information is generated for that subscriber 1312 which is stored in a billing database 
1316. Therefore, the ARS 308 has the ability to inform the subscriber 1312 of each 
transaction, bill for those transactions, and also provide to the subscriber 1312 profile 
information regarding who is accessing the particular product advertisement having 
10 associated therewith the routing information field 904 for a particular routing code as 
described hereinabove. This information, once assembled, can then be transmitted to 
the subscriber 1312 and also be reflected in billing information and stored in the billing 
information database 1316. 

Referring now to FIGURE 14, there is illustrated a flowchart depicting the 
15 operation for storing the profile for the user. The program is initiated in a block 1402 
and then proceeds to a fiinction block 1404, wherein the system will prompt for the 
profile upon initiation of the system. This initiation is a function that is set to activate 
whenever the user initially loads the software that he or she is provided. The purpose 
for this is to create, in addition to the setup information, a user profile. Once the user is 
20 prompted for this, then the program will flow to a decision block 1406 to determine 

whether the user provides basic or detailed information. This is selectable by the user. 
If selecting basic, the program will flow to a function block 1408 wherein the user will 
enter basic information such as name and serial number and possibly an address. 
However, to provide some incentive to the user to enter more information, the original 
25 prompt in fianction block 1404 would have offers for such things as coupons, discounts, 
etc, if the user will enter additional information. If the user selects this option, the 
program from the decision block 1406 to a fiinction block 1410. In the function block 
1410, the user is prompted to enter specific information such as job, income level, 
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general family history, demographic information and more. There can be any amount 
of information collected in this particular function block. 

Once all of the information is collected, in either the basic mode or the more 
specific mode, the program will then flow to a function block 1412 where this 
5 information is stored locally. The program then flows to a decision block 1414 to then 
go on-line to the host or the ARS 308. In general, the user is prompted to determine 
whether he or she wants to send this information to the host at the present time or to 
send it later. If he or she selects the "later" option, the program will flow to a function 
block 1415 to prompt the user at a later time to send the information. In the disclosed 
10 embodiment, the user will not be able to utilize the software until the profile 

information is sent to the host. Therefore, the user may have to activate this at a later 
time in order to connect with the host. 

If the user has selected the option to upload the profile information to the host, 
the program will flow to the function block 1416 to initiate the connect process and 

15 then to a decision block 1418 to determine if the connection has been made. If not, the 
program will flow along a "N" path to a time to decision block 1420 which will time to 
an error block 1422 or back to the input of the connect decision block 1418. The 
program, once connected, will then flow along a "Y" path from decision block 1418 to 
a function block 1428 to send the profile information with the ID of the computer or 

20 user to the host. The ID is basically, as described hereinabove, a "cookie" in the 
computer which is accessed by the program when transmitting to the host. The 
program will then flow to a function block 1430 to activate the program such that it, at 
later time, can operate without requiring all of the set up information. In general, all of 
the operation of this flowchart is performed with a "wizard" which steps the user 

25 through the setup process. Once complete, the program will flow to a Done block 1432. 
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Referring now to FIGURE 15, there is illustrated a flowchart depicting the 
operation of the host when receiving a transaction. The program is initiated at a start 
block 1502 and then proceeds to decision block 1504, wherein it is determined whether 
the system has received a routing request, i.e., the routing information 904 in the form 
5 of a tone, etc., embedded in the audio signal as described hereinabove with respect to 
FIGURE 9. The program will loop back around to the input of decision block 1504 
until the routing request has been received. At this time, the program will flow along 
the "Y" path to a function block 1506 to receive the primary routing information and 
the user ID. Essentially, this primary routing information is extracted from the audio 
10 tone, in addition to the user ID. The program then flows to a function block 1508 to 
look up the manufacturer URL that corresponds to the received primary routing 
information and then return the necessary command information to the originating PC 
^ 108 in order to allow that PC to connect to the destination associated with the primary 

3 routing information. Thereafter, the program will flow to a function block 1510 to 

n 1 5 update the transaction database 1 3 1 0 for the current transaction. In general, the routing 
Z information 904 will be stored as a single field with the associated IDs. The profile 

database, as described hereinabove, has associated therewith detailed profiles of each 
user on the system that has activated their software in association with their ID. Since 
r; the ID was sent in association with the routing information, what is stored in the 

3 20 transaction database is the routing code, in association with all of the IDs transmitted to 
the system in association with that particular routing code. Once this transaction 
database has been updated, as described hereinabove, the transactions can be transferred 
back to the subscriber at node 312 with the detailed profile information from the profile 
database 1308. 

25 The profile information can be transmitted back to the subscriber or 

manufacturer in the node 312 in realtime or non-realtime. A decision block 1512 is 
provided for this, which determines if the delivery is realtime. If realtime, the program 
will flow along a "Y" path to a function block 1514 wherein the information will be 
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immediately forwarded to the manufacturer or subscriber. The program will then flow 
to a function block 1516 wherein the billing for that particular manufacturer or 
subscriber will be updated in the billing database 1316. The program will then flow 
into an End block 1518. If it was non-realtime, the program moves along the "N" path 
5 to a function block 1520 wherein it is set for a later delivery and it is accrued in the 

transaction database. In any event, the transaction database will accrue all information 
associated with a particular routing code. 

With a realtime transaction, it is possible for a manufacturer to place an ad in a 
magazine or to place a product on a shelf at a particular time. The manufacturer can 

10 thereafter monitor the times when either the ads are or the products are purchased. Of 
course, they must be scanned into a computer which will provide some delay. 
However, the manufacturer can gain a very current view of how a product is moving. 
For example, if a cola manufacturer were to provide a promotional advertisement on, 
for example, television, indicating that a new cola was going to be placed on the shelf 

15 and that the first 1000 purchasers, for example, scanning their code into the network 

would receive some benefit, such as a chance to win a trip to some famous resort in 
Florida or some other incentive, the manufacturer would have a very good idea as to 
how well the advertisement was received. Further, the advertiser would know where 
the receptive markets were. If this advertiser, for example, had placed the television 

20 advertisement in ten cities and received overwhelming response from one city, but very 
poor response from another city, he would then have some inclination to believe that 
either one poor response city was not a good market or that the advertising medium he 
had chosen was very poor. Since the advertiser can obtain a relatively instant response 
and also content with that response as to the demographics of the responder, very 

25 important information can be obtained in a relatively short time. 

It should be noted that the disclosed embodiment is not limited to a single 
source PC 302, but may encompass a large number of source computers connected over 

Atty. Dkt. No.: PHLY-25,509 30 



a global communication network. Additionally, the embodiment is not limited to a 
single ARS 308 or a single advertiser server 312, but may include a plurality of ARS 
and advertiser systems, indicated by the addition of ARS 314 and advertiser server A 
316, respectively. It should also be noted that this embodiment is not limited only to 
5 global communication networks, but also may be used with LAN, WAN, and peer-to- 
peer configurations. 

It should also be noted that the disclosed embodiment is not limited to a 
personal computer, but is also applicable to, for example, a Network Computer 
("NetPC"), a scaled-down version of the PC, or any system which accommodates user 
10 interaction and interfaces to information resources. 



One typical application of the above noted technique is for providing a 
triggering event during a program, such as a sport event. In a first example, this may be 
generated by an advertiser. One could imagine that, due to the cost of advertisements in 

15 a high profile sports program, there is a desire to utilize this time widely. If, for 

example, an advertiser contracted for 15 seconds worth of advertising time, they could 
insert within their program a tone containing the routing information. This routing 
information can then be output to the user's PC which will cause the user's PC to, via 
the network, obtain information from a remote location typically controlled by the 

20 advertiser. This could be in the form of an advertisement of a length longer than that 
contracted for. Further, this could be an interactive type of advertisement. An 
important aspect to the type of interaction between the actual broadcast program with 
the embedded routing information and the manufacturer's site is the fact that there is 
provided in the information as to the user's PC and a profile of the user themselves. 

25 Therefore, an advertiser can actually gain realtime information as to the number of 

individuals that are watching their particular advertisement and also information as to 
the background of those individuals, profile information, etc. This can be a very 
valuable asset to an advertiser. 
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In another example, the producer of the program, whether it be an on-air 
program, a program embedded in a video tape, CD-ROM, DVD, or a cassette, can allow 
the user to automatically access additional information that is not displayed on the 
screen. For example, in a sporting event, various statistics can be provided to the user 
5 from a remote location, merely by the viewer watching the program. When these 
statistics are provided, the advertiser can be provided with profile information and 
background information regarding the user. This can be important when, for example, 
the user may record a sports program. If the manufacturer sees that this program 
routing code is being output from some device at a later time than the actual broadcast 
10 itself, this allows the advertisers to actually see that their program is still being used and 
also what type of individual is using it. Alternatively, the broadcaster could determine 
the same and actually bill the advertiser an additional sum for a later broadcast. This is 
'^3 all due to the fact that the routing information automatically, through a PC and a 

fi network, will provide an indication to the advertiser for other intermediary regarding 

If] , , . . 

T-^ 15 the time at which the actual information was broadcast, 

■a 

£ The different type of medium that can be utilized with the above embodiment 

are such things as advertisements, which are discussed hereinabove, contests, games, 
news programs, education, coupon promotional programs, demonstration media 

C3 (demos), photographs, all of which can be broadcast on a private site or a public site. 

20 This all will provide the ability to allow realtime interface with the network and the 

remote location for obtaining the routed information and also allow for realtime billing 
and accounting. 

Referring now to FIGURE 16, there is illustrated a general block diagram of a 
disclosed embodiment. A bar code scanning wand 1600 is provided by a wand 
25 distributor to customers and is associated with that distributor via a wand ID stored 
therein. The wand 1600 is either sold or freely distributed to customers for use with 
their personal computing systems. Since more and more products are being sold using 
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bar codes, it can be appreciated that a user having the wand 1600 can scan bar codes of 
a multitude of products in order to obtain more information. Information about these 
products can be made immediately available to the user from the manufacturer for 
presentation by the user's computer 302, Beyond simply displaying information about 
5 the product in which the user is interested, the wand distributor may include additional 
advertising information for display to the user such as information about other 
promotions or products provided or sold by the wand distributor. Similarly, advertisers 
may provide catalogs of advertisements or information in newspapers or periodicals 
where the user simply scans the bar code associated with the advertisement using the 

10 wand 1600 to obtain further information. There is provided a paper source 1602 having 
contained thereon an advertisement 1604 and an associated bar code 1606. (Note that 
the disclosed concept is not limited to scanning of bar codes 1606 from paper sources 
1602, but is also operable to scan a bar code 1606 on the product itself Also, the wand 
1600 can be any type of device that will scan any type of image having information 

15 encoded therein.) Further description of applications and operation of the bar code 

scanning wand 1600 and the use of the bar code information is found in pending U.S. 
Patent Application, Serial No. 09/151,471 filed on September 11, 1998 and entitled 
"METHOD FOR INTERFACING SCANNED PRODUCT INFORMATION WITH A 
SOURCE FOR THE PRODUCT OVER A GLOBAL NETWORK," which application 

20 is incorporated by reference in its entirety herein. 

After obtaining the wand 1600 from the wand distributor, the user connects the 
wand 1600 to their PC 302. During a scanning operation, wand 1600 reads bar code 
data 1606 and the wand ID into a "wedge" interface 1608 for conversion into keyboard 
data, which keyboard data is passed therefrom into the keyboard input port of PC 302. 
25 The importance of the wand ID will be discussed in more detail hereinbelow. 

The wedge interface 1608 is simply an interface box containing circuitry that 
accommodates inputs from both the scanning wand 1600 and a computer keyboard 
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1610. This merely allows the information scanned by the wand 1600 to be input into 
the PC302. In the disclosed embodiment, the wedge interface 1608 will convert any 
information. The data output from the wand 1600 is passed into the wedge interface 
1608 for conversion into keyboard data which is readily recognizable by the PC 302. 
5 Therefore, the wand 1600 is not required to be connected to a separate port on the PC 
302. This data is recognized as a sequence of keystrokes. However, the output of the 
wand 1600 can be input in any manner compatible with the PC 302. When not 
receiving scanner data, the wedge interface 1608 simply acts as a pass-through device 
for keyboard data from the keyboard 1610. In any case, the information is ultimately 
1 0 processed by a processor in the PC 302 and can be presented to the user on a display 
1612. The wedge interface is operable to provide a decoding function for the bar code 
and conversion thereof to keystroke input data. 

In operation, the product code of a product is provided in the form of a bar code 
1606. This bar code 1606 is the "link" to a product. The disclosed embodiment is 

15 operable to connect that product information contained in the bar code 1606 with a web 
page of the manufacturer of that product by utilizing the bar code 1606 as the product 
"identifier." The program operating on the PC 302 provides routing information to the 
ARS 308 after launching the browser on the PC 302 and connecting to the ARS 308 
over the GCN 306, which ARS 308 then performs the necessary steps to cause the 

20 browser to connect to the manufacturer web site, while also providing for an accounting 
step, as will be described in more detail hereinbelow. 

The bar code 1606 by itself is incompatible with any kind of network for the 
purposes of communication therewith. It is primarily provided for a retail-type setting. 
Therefore, the information contained in the bar code 1606, by itself, does not allow for 
25 anything other than identification of a product, assuming that one has a database 1614 
containing information as to a correlation between the product and the bar code 1606. 
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The wedge interface 1608 is operable to decode the bar code 1606 to extract the 
encoded information therein, and append to that decoded bar code information relating 
to an ID for the wand 1600. This information is then forwarded to the ARS by the 
resident program in the PC 302. This is facilitated by intermediate routing information 
5 stored in the program indicating to which node on the GCN 306 the scanned bar code 

information is to be sent, i.e., to the ARS 308. It is important to note that the 
information in the bar code 1606 must be converted from its optical image to numerical 
values which are then ultimately input to the keyboard input port of PC 302 and 
converted into data compatible with communication software residing on the PC 302 

10 (in this case, HTML language for insertion into a browser program). When the scanned 
information is input to the PC 302, the resident program launches the browser program 
and then assembles a communication packet comprised of the URL of the ARS 308, the 
wand ID and the user ID. If another type of communications program were utilized, 
then it would have to be converted into language compatible with that program. Of 

15 course, a user could actually key in the information on the bar code 102 and then 

append the appropriate intermediate routing information thereafter. As will be 
described hereinbelow, the intermediate routing information appended thereto is the 
URL of the ARS 308 disposed on the GCN 306. 

As part of the configuration for using the wand 1600, the PC 302 hosts wand 
20 software which is operable to interpret data transmitted from the wand 1600, and to 

create a message packet having the scanned product information and wand ID, routing 
information, and a user ID which identifies the user location of the wand 1600. The 
wand software loads at boot-up of the PC 302 and runs in the background. In response 
to receiving a scanned bar code 1606, the wedge interface outputs a keystroke code 
25 (e.g., ALT-FIO) to bring the wand program into the foreground for interaction by the 

operating system. The wand program then inserts the necessary information into the 
browser program. The message packet is then transmitted to interface 304 across the 
global communication network 306 to the ARS 308. The ARS 308 interrogates the 
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message packet and performs a lookup function using the ARS database 310. If a 
match is found between particular parameters of the message packet, a return message 
packet is sent back to the PC 302 for processing. 

The wand program running on PC 302 functions to partition the browser 
5 window displayed to the user into several individual areas. This is for the purpose of 

preparing to present to the user selected information in each of the individual areas (also 
called "framing"). The selected information comprises the product information which 
the user requested by scanning the bar code 1606 using the wand 1600, information 
about the wand distributor which establishes the identity of the company associated 
10 with that particular wand 1600, and at least one or more other frames which may be 
5 advertisements related to other products that the wand distributor sells. Note that the 

'i advertisements displayed by the wand distributor may be related to the product of 

3 interest or totally unrelated. For example, if a user scans the bar code 1606 of a 

n Company A soda, the wand distributor may generate an advertisement of a new soft 

Z 1 5 drink being marketed by Company A, that it sells. On the other hand, the wand 

distributor may also structure the display of information to the user such that a user 
requesting product information of a Product X may get the requested information of 
7i Product X along with advertisements for a competing item Product Y. Essentially, the 

^ wand distributor is free to generate any advertisement to the user in response to the user 

20 requesting product information. 

The return message packet transmitted from the ARS 308 to the PC 302 is then 
transmitted back across the GCN 306 to the advertiser server 312. The advertiser server 
312 restructures the message packet and appends the particular product information for 
transmission back to the PC 302. Upon receiving the particular advertiser information 
25 from advertiser server 312, the PC 302 then retransmits a message to the wand 

distributor site 1616 and E-commerce site 1618 to obtain the information that needs to 
be framed in the browser window displayed to the user. 
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Therefore, the wand 1600 is associated with the wand distributor by way of a 
wand ID such that scanning a product bar code 1606 in order to obtain information 
about that particular product generates one or more responses from one or more remote 
sites disposed on the GCN 306. Stored in the wand 1600 is the wand ID which 
5 establishes its relationship to the wand distributor. Proprietary wand software running 
on the PC 302 operates to decode scanned bar code information and the wand ID 
received from the wand 1600 and wedge interface 1608, and also provides a unique user 
ID for establishing the location of the user of the wand 1600. The wand software also 
assembles message packets and works in conjunction with the on-board communication 
10 software (e,g., a browser) to automatically route the message packets across the GCN 
306 such that the one or more remote sites disposed on the GCN 306 return information 
to be framed for presentation to the user. 

Referring now to FIGURE 16a, there is illustrated an addition to the flowchart 
of FIGURE 14 for registering an input device, for one embodiment of the disclosure, 

15 with the ARS 308 in conjunction with a user ID. As described hereinabove, each user, 
when they generated their user profile when first contacting the ARS 308 to activate 
their software, defines a user ID for storage in their PC resident software. This user ID, 
as also described hereinabove, is utilized to identify the PC 302 to the ARS 308 
whenever making a transaction. This is utilized for, among other things, updating 

20 profile information in the database 310. However, when an input device, such as the 
input device in the form of a wand 1600, is utilized, there are a number of ways to 
identify this wand 1600. One can be with the use of a unique wand ID associated with 
the wand 1600, as will be described hereinbelow. The other is to create a wand ID in 
the software program operating in the PC 302 running the PC resident background 

25 program as described hereinabove. In a situation where the ID is created in the 

program, reference is made to block 1410 of FIGURE 14 and subsequent thereto. After 
the user has entered very specific information, jobs, history and demographics, etc., the 
system will then prompt the individual for information regarding the input device, as 
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indicated by a function block 1630. This prompt will basically inquire as to whether 
the user has an input device for reading machine readable code or for sensing audible 
signals. It may desire to know whether the user has received an audible code from a 
broadcast system such as a TV, or the wand 1600 is being utilized to scan machine 
5 readable code in the form of a bar code. The program block will then flow to a function 
block 1632 wherein various input device types are presented to the user on their display 
returned over the network 306 from the ARS 308, and then the user selects which type 
of input device is attached to their computer. For example, it might be a scanning 
wand, it might be an audio input device, or any other type of device that allows for 
10 input of information. For example, it is conceivable that the unique wand ID is that of 
some type of tool being utilized in conjunction with the program as an input device. 

^ The unique want ID could even be the idea of a disk drive wherein the wand ID would 

'i be generalized as a tool ID. 

fl Once the type of input device is input, then the prompt will query what type of 

I 15 device is attached, such as the type of scanning wand 1600. The system will then ask 

for the distributor of the wand 1600. Of course, as described hereinabove, the wand 
a. 1600 could have embedded therein a unique wand ID which would remove the need for 

r; inputting the distributor, as the ARS 308 will recognize this particular wand ID. 

J However, in the situation wherein the wand ID is not disposed within the wand 1600, 

20 then the user will have to view the wand or tool 1600 to determine the distributor 

thereof This is what input information would then be noted in the user profile in the 
ARS 308. This allows the ARS 308, at a later time, to match up the user ID, requiring 
no other user ID, with their user profile to determine what distributor distributed their 
wand 1600, such that information can be returned associated with that distributor, as 
25 will be described hereinbelow. Therefore, the combination of a user ID and a 

corresponding entry in the database of the ARS 308 will constitute the wand ID or tool 
ID. 
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Referring now to FIGURE 17, there is illustrated a conversion circuit of the 
wedge interface. A microcontroller 1700 provides conversion of the data from the 
wand 1600 and controls interfacing of the keyboard 1610 and wand 1600 with the PC 
302. The microcontroller 1700 has contained therein a memory 1702 for storing a 
5 wand ID (or even a URL for some applications) or it can have external memory. There 
are provided a plurality of wand interfaces 1704 to the wand 1600, a plurality of PC 
interfaces 1706 to the PC 302, and plurality of keyboard interfaces 1708 to the 
keyboard 106. In general, the wand interfaces 1704 comprise a serial data line, a 
ground line, and a power line. Similarly, the keyboard interfaces 1708 comprise a serial 

10 data line, a ground line, a clock line, and a power line. The PC 302 provides a clock 

line, a power line, a serial data, and a ground line for input to the microcontroller 1 700. 
The microcontroller 1700 is operable to receive signals from the keyboard 1610 and 
transfer the signals to the PC 302 as keyboard signals. Operation with the keyboard 
1610 is essentially a "pass-through" procedure. Data output from the keyboard 1610 is 

1 5 already in keyboard format, and therefore requires no conversion by the wedge interface 

1608. With respect to the wand 1600, the serial data is not compatible with a keyboard 
1610 and, therefore, it must be converted into a keyboard format in order to allow input 
thereof to the keyboard input of the PC 302. 

The microcontroller 1700 performs the conversion function after decoding this 
20 bar code information, and conversion of this bar code information into an appropriate 
stream of data which is comprised of the bar code information and the appended wand 
ID (or even a URL in some applications). This appended wand ID (and/or URL) will 
be pre-stored in the memory 1702 and is programmable at the time of manufacture. It 
is noted that the memory 1702 is illustrated as being contained within the 
25 microcontroller 1702 to provide a single chip solution. However, this could be external 
memory that is accessible by the microcontroller 1702. Therefore, the microcontroller 
1700 provides an interface between the wand 1600 and the keyboard 1610 to the PC 
302 which allows the wand 1600 to receive coded information and convert it to 
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keyboard strokes or, alternatively, to merely pass-through the keystrokes from the 
keyboard 1610. Therefore, the user need not install any type of plug-in circuit board 
into the motherboard of the PC 302 in order to provide an interface to the wand 1600; 
rather, the user need only utilize the already available keyboard port in order to input 
5 the appropriate data into the system. 



In this particular disclosed embodiment, the microcontroller 1700 comprises a 
PIC16C73 microcontroller by Microchip Technologies™, The PIC16C73 device is a 
low cost CMOS 8-bit microcontroller with an integrated analog-to-digital converter. 
The PIC16C73 device, as illustrated in the disclosed embodiment, has 192 bytes of 
10 RAM and 4k x 4 of EPROM memory. The microcontroller 1700 can accommodate 
asynchronous or synchronous inputs from input devices connected to it. In this 
disclosed embodiment, communication to the keyboard 1610 is synchronous while it is 
asynchronous when communicating with wand 1600. 

It should be noted that, although in this particular embodiment bar code 
15 information of the bar code 1606 is input into the keyboard input port of the PC 302, 

disclosed methods may also be advantageously utilized with high speed port 
architectures such as Universal Serial Bus ("USB") and IEEE 1394. 

Bar codes are structured to be read in either direction. Timing considerations 
need to be addressed because of the variety of individuals scanning the bar code 

20 introduce a wide variety of scan rates. Bar codes use bars of varying widths. The 
presence of a black bar generates a positive pulse, and the absence of a black bar 
generates no pulse. Each character of a conventional bar code has associated therewith 
seven pulses or bars. Depending on the width of the bars, the time between pulses 
varies. In this disclosed embodiment, the interface circuitry 1608 performs a "running" 

25 calculation of the scan time based upon the rising edge of the pulses commencing with 
the leader or header information. The minimum and maximum scans times are 
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calculated continuously in software with the interface 1 608 during the scanning process 
to ensure a successftil scan by the user. 

Referring now to FIGURE 18, there is illustrated a sample message packet 
transmitted from the user's PC 302 to the ARS. The message packet 1800 comprises a 
5 number of bits of information including the bar code information 1 802 obtained from 
the user scanning the bar code with the wand 1600; the wand ID 1804 which is 
embedded in a memory in the wand 1600 and identifies it with a particular wand 
distributor; and a user ID 1806 which is derived from the software running on the PC 
302 and which identifies uniquely with the user location. Note that the message packet 
10 includes other necessary information for the proper transmission for point to point. 

Referring now to FIGURE 19, there is illustrated a more detailed block diagram 
of the routing of the message packets in order to present the framed information to the 
user. As is mentioned hereinabove, when the user scans a bar code 1 606 using the 
wand 1600, a wand program running on the user PC 302 is operable to interpret the 

1 5 information output by the wand 1600 and generate a message packet for transmission 
over the GCN 306. The wand program assembles the message packet such that it is 
directed to the ARS 308 disposed on the GCN 306. The message packet contains 
several pieces of information including the wand ID 1 804 which links it to the wand 
distributor, the user ID 1806 which identifies the particular user using the wand 1600, 

20 and bar code information describing a particular product of interest to the user. This 
message from the PC 302 is transmitted over a path 1900 to the ARS 308 where the 
ARS database 310 is accessed to cross reference the ID information and bar code 
information to a particular advertiser and wand distributor. The ARS 308 returns a 
message packet over a path 1902 to the user PC 302 which contains routing information 

25 as to the location of various other sites disposed on the GCN 306, for example, the 
advertiser server 312 and wand distributor site 1616. 
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It is noted that, when the wand (or tool) is utilized, the program at the PC may 
recognize this and merely input the user ID in the want (or tool) ID field. Alternatively, 
the mere receipt of a user ID in association with product code information will trigger 
the ARS 308 to assume that the want 1600 was utilized. It is only important that the 
5 use of the want (or tool) be recognized and that the user's PC be routed to a location on 
the network preassociated with that wand (or tool) distributor. Further, it is the routing 
of the user's PC to a predetermined location on the network based upon the use of a 
particular tool, a particular type of tool or a general class of tools that elicits the 
connection. For example, it would be that the network connection is made in response 
10 to the suer utilizing a bar code scanner. This would connect the user to a website for a 
general bar code scanner tool. For a disk drive, the program would recognize that a 
disk drive had been installed (or merely used) and then route the user to the website of 
the disk drive manufacturer, a competitor of such or even to some marketing firm that 
wants to contact individuals that use or initiate such a piece of equipment. 



^15 It can be appreciated that other information can also be provided by the ARS 

308 which more closely targets the particular user of the wand 1600. For example, if it 
1 is known that a particular wand 1600 is sold in a certain geographic area, this 

i information can be useful in targeting the particular user with certain advertising 

i information relevant to that geographic area. In any case, the information returned from 

20 the ARS 308 over path 1902 provides enough information for the wand program 

running on the user PC 302 to identify a number of other sites disposed on the GCN 
306. The user PC 302 then processes the return message packet and routes another 
message packet over a path 1904 to the advertiser server 312. The advertiser server 312 
then returns product information of the particular product in which the user was 
25 interested back to the user PC 302 over a path 1906. Similarly, the user PC 302 routes 
information (e.g., the URL of the wand distributor site and the user profile) to the wand 
distributor site 1616 over a path 1908 in order to obtain information back over a path 
1910 for framing any banners which identify the wand distributor. Additionally, the 
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user PC 302 forwards a message packet to the E-commerce site 1618 over a path 1912 
in order to return information regarding any particular advertisements the wand 
distributor wants to display to the user. The advertisements are returned to the PC 302 
over a path 1914. 

5 Referring now to FIGURE 20, there is illustrated a block diagram of a browser 

window according to the disclosed embodiment. The browser window 2000 is 
partitioned into a plurality of areas for framing specific information. A bar code area 
2002 displays that product information in which the user was interested; a wand 
specific area 2004 displays information about the wand distributor; and an E-commerce 

10 area 2006 displays advertising information that the wand distributor selects for display 
according to this particular user and wand 1600. As mentioned hereinabove, a program 
operable to process scanned bar code information with the unique wand 1600 develops 
the browser window by partitioning it into specific areas for the framing of information. 
Therefore, information returned from the E-commerce site 1608 is passed through the 

1 5 GCN 306 to the particular E-commerce frame 2006. Similarly, information about the 
particular product of interest is returned from the advertiser site 312 across the GCN 
306 to the particular bar code specific area 2002. Information placed in the wand 
specific area 2004 is information about the wand distributor which is retumed from the 
wand distributor site 1616 across GCN 306. 

20 Referring now to FIGURE 21, there is illustrated a structure of information 

contained in the ARS database. The ARS database 310 contains a variety of 
information required to properly interrogate and assemble packets for obtaining 
information from the various sites disposed on the GCN 306. The ARS database 310 
has a database structure 2100 which contains addresses for the web sites containing the 

25 product information requested by the user when scanning the bar code 1606 with the 
wand 1600. Under a product heading 2102 are listed the particular bar codes and 
associated routing information for addressing the respective server location. For 
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example, the ARS server 308 may contain any number of advertisers having unique 
URL addresses associated therewith. Therefore, the bar code 1606 of a particular 
product is associated with a unique URL address which routes any request for 
information of that product to that particular advertiser's site. Also part of the ARS 
5 database structure 2000 is a heading of wand under which is the wand ID 1 804 and the 
distributor associated with that wand ID 1804. 

It can be appreciated that there may be a number of distributors using the 
disclosed architecture such that each distributor has an ID embedded in the wand which 
uniquely identifies that wand with the particular distributor. Therefore, the unique 

10 wand ID 1 804 needs to be listed with the respective distributors of that wand 1600 in 

order to process the information that needs to be framed and displayed to that particular 
user. Another heading under the ARS database structure 2100 is a user heading 2106 
which contains profile information associated with that particular user ID 1806. As 
mentioned hereinabove, the user ID 1806 is obtained via the wand software running on 

15 the PC 302 and upon installation or subsequent configuration may request that the user 

input certain profile information which may be used to target that particular user with 
products and services which identify with that user profile. The ARS database structure 
2100 also contains an E-commerce heading 2108 which contains information related to 
the bar code 1606 and an advertisement that may be triggered by the request for that 

20 information. For example, any bar code 1606 associated with a paper sourcel600 can 
be associated with the specific information in the ARS database 310. A user wishing to 
obtain information about a specific soft drink may, in fact, trigger an advertising 
response of a competitor product. Similarly, the user interested in information about 
that particular soft drink may also trigger information which is relevant to that 

25 particular product or a product which may normally be served in conjunction with that 
soft drink. Furthermore, if the user profile indicates that this individual has significant 
interest in finance or insurance, the request for information regarding this particular bar 
coded product may trigger advertisement from an E-commerce server 1618 related to 
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information about finance and insurance. It should be noted that the information 
described as contained within the ARS database structure 2100 is not Hmited to what 
has been described, but may comprise any number of pieces of information used to 
present desired information to the computer display of the user. 

5 Referring now to FIGURE 22, there is illustrated a flowchart of the process of 

receiving information from the user's perspective, and according to the disclosed 
embodiment. The wand software running on the user's PC 302 runs in the background 
until activated by output fi-om the wand 1600. Therefore, flow moves to a decision 
block 2200 where if a scanned input does not occur, flow moves out the "N" path and 

10 loops back to the input of decision block 2200. On the other hand, if scanned input 
information is received, flow moves out the "Y" path to a function block 2202 where 
the wand software assembles a message packet containing the bar code information, the 
wand ID 1804 and the ARS 308 URL address. Additionally, the browser is launched in 
which this information is placed for transmission to the ARS 308. Flow then moves to 

1 5 a function block 2204 where the browser is partitioned into any number of areas in 

which information is displayed when obtained from the wand distributor site 1616, the 
E-commerce site 161 8, and the advertiser server 312. It should be known that although 
three frames are shown in the particular window 2000 of this embodiment, the number 
of frames displayed in the window 2000 is limited only by the available real estate of 

20 the window 2000 area itself. 

After the wand software partitions the browser window into one or more frames 
in preparation of receipt of return information, flow moves to a decision block 2206 
where the computer waits for information to be returned from the various sites disposed 
on the GCN 306. If information is not returned, flow moves out the "N" path and 
25 simply loops back to the input to continue monitoring for receipt of the information. If 
information has been received, flow moves out the "Y" path to a function block 2208 
where routing information for each frame (or partitioned area of the window 2000) is 
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inserted into one or more packets for transmission to the various sites. The various sites 
then return the requested information back to the PC 302, as indicated in function block 
2210. Flow is then to a function block 2212 where the proprietary software working in 
conjunction with the hosted browser places the returned information into the respective 
frames of the window. The user, viewing the display at PC 302, then perceives a 
variety of information, one of which is the particular product information which he or 
she requested, in addition to wand distributor information, and possibly other 
advertisements based upon the user's profile. 

Referring now to FIGURE 23, there is illustrated a flowchart of the process 
according to the ARS. The ARS 308 is operable to decode and process message 
received from the GCN 306. Therefore, flow is to a decision block 2300 where, if bar 
code information is not received, flow is out the "N" path with loop-back to its input. If 
bar code information has been received, flow is to a function block 2302 where a 
matching process occurs to link the bar-coded product information to its respective 
manufacturer. The ARS database 310 also associates the URL address of the 
manufacturer's server. When a match is found, the ARS 308 begins to assemble a 
message packet of information for transmission back to the PC 302, as indicated in 
function block 2304. The message packet contains the product information and the 
URL address of the manufacturer's website. Flow then moves to a decision block 2306 
where the wand ID 1804 is compared with the list of wand IDs issued by the particular 
wand distributor. If the wand ID 1804 is validated, flow moves out the "Y" path to a 
function block 2308 where the message packet is appended with the wand ID 1804 and 
distributor routing address. Flow then moves to a decision block 23 10 where the ARS 
308 determines if any E-commerce information is to be associated with a particular 
wand ID 1804. If so, flow is out the "Y" path to a function block 2312 where the 
message packet is appended with the E-commerce routing string. The E-commerce 
routing string provides addressing for the E-commerce server 1618. Flow then moves 
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to a function block 2314 where all message packets are returned back to the PC 302 for 
processing. 

Referring back to decision block 2306, if the wand ID 1804 is determined to be 
invahd, flow moves out the "N" path and jumps forward to the input of decision block 
5 23 14, since the lack of a wand ID 1804 interrupts the link to any advertising provided 
by the E-commerce server 1618. At this point, the only information provided is the link 
to the adverse server 312 for return of product information. Referring now to decision 
block 2310, if no E-commerce information is available, flow moves out the "N" path 
and jumps forward to the input of function block 2314 where the message packet back 
1 0 to the PC 302 contains only the URL of the advertiser server 3 1 2, the bar code 
information, the distributor server 1616 address and wand ID 1804 information. 

Referring now to FIGURE 24, there is illustrated a flowchart of the process 
performed at the E-commerce site. The E-commerce server 1618 receives the message 
packet from the user PC 302, as indicated in function block 2400, and decodes the 

15 packet to perform a match with the bar coded information. Moving on to a decision 
block 2402, if the match is unsuccessful, flow is out the "N" path to a function block 
2404 where the match is rejected. A message may be returned to indicate that a 
problem occurred and the user may need to re-scan the product bar code 1606. If a 
successful match occurs, flow moves out the "Y" path to a function block 2406 where 

20 the wand ID 1 804 is matched with the bar code product information. The bar coded 
information may be distributed to customers over a large geographic area. However, 
the wand 1606 may be coded for certain geographic areas. For example, a wand 1600 
having an XXX ID may be restricted for sale in the Southwestern United States while a 
wand 1600 having a YYY ID may be sold only in the Northeast. In this way, 

25 geographic areas may be targeted with advertising more appealing to that particular 
area. Advertising returned to the user PC 302 may be focused further by obtaining a 
user profile when the software or wand 1600 are installed. In this way, advertising may 
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be focused based upon the user profile. Therefore, flow moves to a function block 
2408 to lookup the E-commerce action based upon the wand ID 1804 and the bar code 
information. Flow moves to a function block 2410 to assemble all the information into 
a packet for return to the user PC 302. The product information and/or user profile 
5 information may be returned. Flow is then to a function block 2412 where the message 
packet is transmitted. 

FIGURE 25a illustrates a bar code 2502 which can be scanned with the wand 
1600 to extract the information contained therein. Typically, these bar codes are 
associated with a product or a service and they will have the decoded information 

10 disposed thereunder in the form of numbers, this represented by a series of "xxx's." 

These bar codes are conventional and can be generated with many types of programs. 
However, they are usually uniquely associated with a given product or product UPN or 
they can be generated for any type of application a user desires them for. However, 
with a UPN, they have specific links and specific fields. For example, a certain portion 

1 5 of the bar code 2502 when associated with a product having a UPN, this portion will 
define the company. Therefore, all UPNs for a given company will have this set 
portion and it will always be the same. 

The bar code 2502 is disposed on a surface, either the surface of a product or 
even an advertisement or a tag associated with the product. It is typically in close 

20 association with that product or service. On the surface in proximity thereto is 
provided a logo 2504. This logo is an indicia of the fact that the bar code 2502 is 
associated with the system described hereinabove, i.e., when this bar code 2502 is 
scanned with the PC 302 running the appropriate software, this indicates that 
information is in the database of the ARS 308. Of course, the user does not know that 

25 this information must first be obtained from ARS 308; rather, the user merely knows 
that the indicia 2504 indicates that scanning of the bar code 2502 will launch a 
computer to a destination site. This is unique in that the bar code performs two 
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functions, a retail function and a routing function. However, the user, when selecting 
products, will have no idea that this bar code 2502 on the product can actually allow 
them to have access to a defined location on the network without the indicia 2504. 

Referring now to FIGURE 25b, there is illustrated an alternate embodiment, 
5 wherein the bar code 2502 is surrounded by a border 2506, which border 2506 can be a 
particular color that can stand out. Typically, this bar code 2502 will be disposed on a 
product on a retail shelf. When the consumer picks up the product, the consumer can 
actually determine which products have a product code for use by the retailer that is 
also useful to access some location on the network. For example, a manufacturer may 

10 want to offer some type of prize or incentive for an individual to purchase their product. 
They could actually offer some type of coupon from the remote location, provided that 
a consumer purchases their product and then scans it with the wand 1600 attached to the 
PC. If this occurs, then the user will be connected to the location and receive some type 
of coupon. However, in order for this to occur, the user must recognize that the product 

1 5 they are purchasing was one that had a UPN associated therewith that was "network 

compatible." This network compatibility indicates to the consumer that they can in fact 
access some location over the network. They are not informed as to what location can 
be located; rather, only that some type of particular location can be located. This 
provides a means by which the manufacturer can possibly sell more product and various 

20 types of coupons that can be uploaded. 

Referring now to FIGURE 26, there is illustrated a block diagram of an ahemate 
embodiment of a system for facilitating access to a location on a network. A 
presentation source 2600 is provided having both a visual aspect 2602 and a sound 
aspect 2604. This, as described hereinabove, can be facilitated by the embodiment of 
25 FIGURE 1. The presentation source 2600 may provide an audio visual presentation or 
a communication having audio and visual content. The presentation provided by 
presentation source 2600 may be broadcast or it may be live. The visual aspect 2602 
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and the sound aspect 2604 may appear together or separately or in various sequences or 
combinations. The visual aspect 2602 may include both program material or visual 
cues indicative of a particular relationship or action or a visually perceivable control 
signal. Similarly, the sound aspect 2604 may include program material, or audible cues 
5 indicative of a particular relationship or action or it may include a control signal. 

Continuing further with FIGURE 26, there is shown a computer 2606 having an 
input device 207 and a block representing a consumer 2608 wherein the computer 2606 
and the consumer 2608 are linked by an interaction link 2612. The computer 2606 and 
the consumer 2608 are further linked with the visual aspect 2602 and the sound aspect 

10 2604 of the presentation source 2600 by a perception link 2610 shown between the 

respective blocks by dashed line paths indicating generally a wireless link over which 
occur the perception of the individual aspects of the presentation by one or both of the 
computer 2606 and the consumer 2608. In some cases a portion of the perception link 
2610 may be a coupling other than wireless. There is further shown coupled with the 

1 5 computer 2606 a network 2614 linked by a bidirectional communication channel 261 6. 
The network 2614 is also coupled to a location on the network 2618 via a bidirectional 
communication link 2620. In the disclosed embodiment, the network 2618 is the GCN 
306. 

In operation, a presentation provided by a presentation source 2600, i.e., a 
20 broadcast station, which may have both visual and sound aspects is perceived by the 
computer and/or the consumer. Visual aspects, such as visual cues, and sound aspects, 
such as audible cues or control signals, may be perceived by either the consumer 2608 
or the computer 2606 to call attention to a particular program element in the 
presentation or associated with the presentation or to a control action that is taking place 
25 or is enabled to take place depending upon the response of the computer 2606 or the 
consumer 2608. For example, during a program segment, a visual cue may appear to 
the consumer 2608 in association with an audible control or launching signal, which 
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together alert the consumer that a control action is occurring, such as establishing 
access to a location on the network in response to the launching signal. The computer 
2606 may include an input device 2607 responsive to the launching signal. The output 
of the input device 2607 is processed by the computer under the control of a program 
5 resident on the computer for establishing a connection via the network 2614 to the 

location on the network 2618 via the bidirectional communication channel 2620. The 
foregoing example is illustrative only and represents many possible variations in the 
operation of such a system. Visual aspect 2602 and the sound aspect 2604 are both 
provided, in an illustrative embodiment shown in FIGURE 26a, by a broadcast source 

10 that broadcasts a program with the various cues and control signals embedded therein. 
A monitor 2620 of either a computer or a television is provided for receiving the 
broadcast. It should be understood that televisions, operating on an NTSC format, 
could be utilized separate and apart from the computer 2606. However, it should be 
understood that the computer 2606 could include as a portion thereof the ability to 

15 receive a broadcast and display that broadcast. However, in this embodiment, a 
separate monitor or TV 2620 is illustrated. 

Continuing with FIGURE 26a, the television 2620 is operable to receive on an 
antenna 2622 the broadcast. This is then displayed on a main display portion 2624. 
This is provided for a viewer 2626 to have the ability to view the program. 

20 Additionally, there is provided a speaker 2628 for providing an audio output. This 
audio output can be provided to the user and also to the computer 2606 through a 
microphone 2630, which comprises the input device 2607. However, as described 
hereinabove, it should be understood that a direct connection between the computer 
2606 and the TV 2620 could be provided for receiving the signal. Further, also 

25 illustrated as an audible signal, the control signal could be a digital signal that is 
encoded within the Vertical Blanking Interval (VBI), a conventional technique for 
providing control information such as closed captioned programming. 
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During the broadcast, it may be desirable for an advertiser or the such to control 
the computer 2606 to interconnect with the remote location 2618 on the network 2614. 
When this occurs, a control signal will be provided to the computer, be that audible, as 
in the disclosed embodiment, or inaudible. This will enable the computer to link to the 
remote location 2618 and retrieve information therefrom for display on a computer 
display 2630. However, it should be understood that any action taken by the computer 
2606 in response to receiving the control information via information received from the 
network could be anticipated. For example, the control information could control a user 
device such as a toy. Although not illustrated, the actions of this toy could actually be 
manipulated by the control signal. 

In the illustrated embodiment, the information that is retrieved is displayed on 
the display 2630. However, in conjunction with the audible tone, which is perceptible 
by the user, there is also provided by video cue 2632. This video cue operates in a 
number of different manners, as will be described hereinbelow. This cue 2632 could 
occur prior to the audible tone or after the audible tone or in conjunction with the 
audible tone. The reason for this is that the audible tone may be masked by the audio 
portion of the broadcast. If the viewer 2626 is viewing the broadcast on the main 
display 2624, the viewer will see the cue 2632, this being a distinctive cue, appear. 
When the viewer 2626 sees the cue 2632 appear, the viewer 2626 will recognize that 
this cue 2632 is associated with some action that is being taken. In the illustrated 
embodiment, this is the presence of relevant information being displayed on the 
computer display 2630. This will cause the viewer 2626 to view the computer display 
2630, as illustrated in phantom. It is noted that the audible portion of the program 
could be made distinctive enough to allow the user to view the display 2630. This is 
described in U.S. Patent Application Serial No. 09/489,879, entitled "METHOD AND 
APPARATUS FOR UTILIZING AN AUDIBLY CODED SIGNAL TO CONDUCT 
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COMMERCE OVER THE INTERNET'XAtty. Dkt. No. PHLY-24,918), which is 
incorporated herein by reference. 

Referring now to FIGURE 27, there is illustrated one possible embodiment of a 
visual cue which may appear among the visual aspects 2602 of a presentation that is 
5 provided in the embodiment illustrated in FIGURE 26, this being the visual cue 2632. 
The visual cue 2700 of FIGURE 27 includes a stylized alphanumeric character or logo 
2702. The logo 2702 in FIGURE 27 is accompanied by a mark of punctuation 
represented by the dot 2704 and the dot 2706, which mark of punctuation occurs in 
conjunction with the logo 2702, together providing a visual cue. In the detailed 
10 description to follow, this visual cue will be illustrated in several embodiments which 
enhance the visual impact of the visual cue of FIGURE 27. 

Referring now to FIGURES 28a, 28b and 28c, there is illustrated an animation 
sequence in three cells involving a visual cue as illustrated in FIGURE 27. In FIGURE 
28a is shown a stylized letter C 2802 having a circular portion 2804 disposed on the 

15 upper extremity of the character 2802. FIGURE 28b shows the same character 2802 
having the same circular portion 2804 in conjunction with the detachment, from the 
character 2802, of a second circular portion 2806 which is caused to move along a path 
2808 to a position 2810 to the left of the character 2802. FIGURE 28c illustrates the 
same character 2802 accompanied by the separation of the circular portion 2806 (which 

20 resided in position 2810) into circular portion 2812 and circular portion 2814. The 

circular portions 2812, 2814 are seen to move upward and downward respectively from 
position 2810 into new positions corresponding to a punctuation mark (colon) disposed 
to the left and adjacent the character 2802. FIGURES 28a, 28b and 28c illustrate the 
motion of a portion of a character or visual cue to form a new version of the visual cue 

25 in a way that attracts attention to itself through the successive movement of the 

respective portion of the character. Thus a colon is formed to the left of the character 
2802 by moving a circular portion away from one part of the character 2802 along a 
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designated path to a position from which it may be further moved to complete the 
modification to the visual cue. It v^iW be appreciated that the sequence illustrated in 
FIGURES 28a, 28b and 28c represent just one of many possible sequences v^hich may 
be conceived and arranged for the same purpose. It will also be appreciated that visual 
5 cues are not limited to alphanumeric characters but may include any kind of visual 
image such as an icon, cartoon, logo or other symbol which may be manipulated in a 
manner similar to that illustrated in FIGURES 28a, 28b and 28c. 

Referring now to FIGURES 29a, 29b and 29c there is illustrated an alternate 
animation sequence 2900 which begins with a character 2902 shown in FIGURE 29a. 

10 This character 2902 is accompanied by a single circular portion 2904 disposed to the 
left of the character 2902. The visual cue in FIGURE 29b shows the circular portion 
2904 being separated into two circular portions 2906 and 2908 moving in respectively 
upward and downward directions to new positions as illustrated in FIGURE 29c, the 
new positions being 2910 and 2912 representing a punctuation mark (colon) disposed to 

15 the left of the character 2902. It will be appreciated that in the embodiment of 
FIGURES 29a, 29b and 29c as well as the embodiments previously described 
hereinabove that the animation of portions of the visual cue may be accompanied by 
various sound aspects depending on the program content of the presentation. 

Referring now to FIGURE 30, there is illustrated a flowchart of one 
20 embodiment of the operation of the system of FIGURE 26, for facilitating access to a 
location on a network. The flow begins at the Start block 3000 and proceeds to a block 
3002 representing the active presentation of a program capable of both visual and sound 
aspects, which program is provided by the presentation source 2600 as illustrated in 
FIGURE 26. Continuing with FIGURE 30, the flow proceeds to a decision block 3004 
25 wherein a determination is made whether it is intended to release a launch signal to 

provide for a control action before providing a visual cue from the presentation. If the 
determination is negative, the flow proceeds to block 3006 where the system presents 
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the visual cue during the presentation of the program. If, however, it was intended to 
release the launch signal, that is, to release a control signal for the purpose of launching 
an application on the computer 2606 to establish a connection via the network 2614 to a 
location on the network 261 8, then the flow follows the Y path to block 3008. In block 
5 3008, the system releases the launch signal and the flow proceeds to a decision block 
3010. In decision block 3010, a determination is made whether a visual cue was 
presented and, if the result of the determination is affirmative, then the flow proceeds to 
a next decision block 3014. If however, a visual cue was not presented previously, then 
the flow proceeds from decision block 3010 along the N path to a block 3012 where the 

10 visual cue is presented by the presentation source and the flow proceeds to decision 
block 3014. In decision block 3014, a determination is made as to whether animation 
of the visual cue has been requested and if the result of that determination is 
affirmative, then the flow follows the Y path to block 3016 wherein the animation 
sequence is performed on the visual cue. Following the completion of the animation 

1 5 sequence, the flow returns to the input to a block 301 8. If however, an animation 

sequence was not requested for the visual cue, then the flow follows the N path from 
decision block 3014 to the input to block 3018 wherein the input device of the computer 
reads the launch signal released during the presentation. The flow proceeds to block 
3020 where the application is launched on the computer 2606 to establish a connection 

20 on the network 2614. The access to the location 2618 on the network 2614 is 

performed in accordance with the application in block 3022. Once the connection is 
established, the routine of FIGURE 30 ends at block 3024. 

It will be appreciated by persons skilled in the art that the flow chart of FIGURE 
30 generally illustrates a process by which visual and/or sound aspects of a presentation 
25 may be utilized to call attention to and to launch an application which provides for 
access to a location on a network via a computer associated with the presentation 
containing the visual and/or sound aspects. FIGURE 30 illustrates several variations 
that are possible such as inverting the order of the visual aspect or the sound aspect that 
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is involved in the action to facilitate the access to a location on a network. Further, the 
providing of the visual cue and the release of the launch signal may occur substantially 
simultaneously, within a predetermined interval of time or in sequence, one after the 
other. Further, the launch signal, typically in the disclosed embodiment an audible 
5 sound, may be configured by its frequency or amplitude to be inaudible to human 

hearing but which may be detected by an input device on the computer of appropriate 
capability. Another variation is the animation of all or a portion of the visual cue with 
or without an associated corresponding sound aspect to enhance the attractability of the 
visual aspect and/or the sound aspect to a consumer who is present during the 

10 presentation and is desirous of establishing the aforementioned access to a location on a 
network, i.e., viewing the computer display. As mentioned hereinabove, the visual cue 
may take many forms including alphanumeric characters or icons, cartoons or other 
kinds of symbols or logos that are appropriate to the presentation being made by the 
presentation source and/or the particular action that is to result from the launch of the 

15 application on the computer in the system of FIGURE 26. 

In addition to the above-noted axis, it is noted that the cue 2632 could be further 
animated by allowing it to traverse the screen. For example, the visible cue could be 
animated as "hopping" across the screen to the lower right-hand comer. This is 
something that will be a perceptible difference in the broadcast that would alert the user 

20 to the fact that some control action were being undertaken and they were to view the 
results of that control action. 

Although the preferred embodiment has been described in detail, it should be 
understood that various changes, substitutions and alterations can be made therein 
without departing from the spirit and scope of the invention as defined by the appended 

25 claims. 
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